Image sensors capable of capturing individual photons have made tremendous progress in recent years. However, this technology faces a major limitation. Because they capture scene information at the individual photon level, the raw data is sparse and noisy. Here we propose CASPI: Collaborative Photon Processing for Active Single-Photon Imaging, a technology-agnostic, application-agnostic, and training-free photon processing pipeline for emerging high-resolution single-photon cameras. By collaboratively exploiting both local and non-local correlations in the spatio-temporal photon data cubes, CASPI estimates scene properties reliably even under very challenging lighting conditions. We demonstrate the versatility of CASPI with two applications: LiDAR imaging over a wide range of photon flux levels, from a sub-photon to high ambient regimes, and live-cell autofluorescence FLIM in low photon count regimes. We envision CASPI as a basic building block of general-purpose photon processing units that will be implemented on-chip in future single-photon cameras.
Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher.
Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?
Some links on this page may take you to non-federal websites. Their policies may differ from this site.
-
Abstract Free, publicly-accessible full text available May 31, 2024 -
Free, publicly-accessible full text available June 1, 2024
-
The ubiquitin-binding NBR1 autophagy receptor plays a prominent role in recognizing ubiquitylated protein aggregates for vacuolar degradation by macroautophagy. Here, we show that upon exposing Arabidopsis plants to intense light, NBR1 associates with photodamaged chloroplasts independently of ATG7, a core component of the canonical autophagy machinery. NBR1 coats both the surface and interior of chloroplasts, which is then followed by direct engulfment of the organelles into the central vacuole via a microautophagy-type process. The relocalization of NBR1 into chloroplasts does not require the chloroplast translocon complexes embedded in the envelope but is instead greatly enhanced by removing the self-oligomerization mPB1 domain of NBR1. The delivery of NBR1-decorated chloroplasts into vacuoles depends on the ubiquitin-binding UBA2 domain of NBR1 but is independent of the ubiquitin E3 ligases SP1 and PUB4, known to direct the ubiquitylation of chloroplast surface proteins. Compared to wild-type plants, nbr1 mutants have altered levels of a subset of chloroplast proteins and display abnormal chloroplast density and sizes upon high light exposure. We postulate that, as photodamaged chloroplasts lose envelope integrity, cytosolic ligases reach the chloroplast interior to ubiquitylate thylakoid and stroma proteins which are then recognized by NBR1 for autophagic clearance. This study uncovers a new function of NBR1 in the degradation of damaged chloroplasts by microautophagy.more » « less
-
Images document scientific discoveries and are prevalent in modern biomedical research. Microscopy imaging in particular is currently undergoing rapid technological advancements. However, for scientists wishing to publish obtained images and image-analysis results, there are currently no unified guidelines for best practices. Consequently, microscopy images and image data in publications may be unclear or difficult to interpret. Here, we present community-developed checklists for preparing light microscopy images and describing image analyses for publications. These checklists offer authors, readers and publishers key recommendations for image formatting and annotation, color selection, data availability and reporting image-analysis workflows. The goal of our guidelines is to increase the clarity and reproducibility of image figures and thereby to heighten the quality and explanatory power of microscopy data.more » « lessFree, publicly-accessible full text available September 14, 2024
-
New quantitative prognostic markers are needed for improved pancreatic ductal adenocarcinoma (PDAC) prognosis. Second harmonic generation microscopy has been used to show that collagen fiber alignment in PDAC is a negative prognostic factor. In this work, a series of PDAC and normal adjacent tissue (NAT) biopsies were imaged with spatial light interference microscopy (SLIM). Quantitative analysis performed on the biopsy SLIM images show that PDAC fiber structures have lower alignment per unit length, narrower width, and are longer than NAT controls. Importantly, fibrillar collagen in PDAC shows an inverse relationship between survival data and fiber width and length (p < 0.05).
-
Changes in the multi-level physical structure of biological features going from cellular to tissue level composition is a key factor in many major diseases. However, we are only beginning to understand the role of these structural changes because there are few dedicated multiscale imaging platforms with sensitivity at both the cellular and macrostructural spatial scale. A single platform reduces bias and complications from multiple sample preparation methods and can ease image registration. In order to address these needs, we have developed a multiscale imaging system using a range of imaging modalities sensitive to tissue composition: Ultrasound, Second Harmonic Generation Microscopy, Multiphoton Microscopy, Optical Coherence Tomography, and Enhanced Backscattering. This paper details the system design, the calibration for each modality, and a demonstration experiment imaging a rabbit eye.
-
Abstract Tissue biopsy evaluation in the clinic is in need of quantitative disease markers for diagnosis and, most importantly, prognosis. Among the new technologies, quantitative phase imaging (QPI) has demonstrated promise for histopathology because it reveals intrinsic tissue nanoarchitecture through the refractive index. However, a vast majority of past QPI investigations have relied on imaging unstained tissues, which disrupts the established specimen processing. Here we present color spatial light interference microscopy (cSLIM) as a new whole-slide imaging modality that performs interferometric imaging on stained tissue, with a color detector array. As a result, cSLIM yields in a single scan both the intrinsic tissue phase map and the standard color bright-field image, familiar to the pathologist. Our results on 196 breast cancer patients indicate that cSLIM can provide stain-independent prognostic information from the alignment of collagen fibers in the tumor microenvironment. The effects of staining on the tissue phase maps were corrected by a mathematical normalization. These characteristics are likely to reduce barriers to clinical translation for the new cSLIM technology.